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MAXIMUM PRINCIPLE FOR LINEAR-CONVEX BOUNDARY 
CONTROL PROBLEMS APPLIED TO OPTIMAL INVESTMENT 

WITH VINTAGE CAPITAL 

- - . SILVIA FAGGIANi 

o _ 

I Abstract. The paper concerns the study of the Pontryagin Maximum Principle for 

an infinite dimensional and infinite horizon boundary control problem for linear partial 
differential equations. The optimal control model has already been studied both in finite 
and infinite horizon with Dynamic Programming methods in a series of papers by the 
same author et al. [26, 27, 28, 29, 30]. Necessary and sufficient optimality conditions for 
open loop controls are established. Moreover the co-state variable is shown to coincide 
with the spatial gradient of the value function evaluated along the trajectory of the 
system, creating a parallel between Maximum Principle and Dynamic Programming. 
The abstract model applies, as recalled in one of the first sections, to optimal investment 
with vintage capital. 
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. Optimal investment problems, Vintage capital. 

1. Introduction 

O ■ The paper concerns the study of the Pontryagin Maximum Principle for a infinite di- 
mensional and infinite horizon boundary control problem for linear partial differential 
^ , equations. More precisely, we take into account a state equation of type 
H ■ 

y'ir) = Aovir) + Bu{t), t G [t, +oo) 
y{t) = xeH, 



where H is the state space, y : [t, +oo) ^ H is the trajectory, U is the control space 
and u : [t,+oo) —>■ U is the control, Aq : D{Aq) G H ^ H is the infinitesimal generator 
of a strongly continuous semigroup of linear operators {e'^^°}T>o on H, and the control 
operator B is linear and unbounded, say B : U [D{Aq)]'. Besides, we consider a cost 
functional given by 

r+oo 

(1.2) J^{t,x,u)= / e-^^[goiyir)) + ho{uir))]dT 
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where the functions (po and, for all fixed r in [0, T] , and ho are convex functions as 
better specified later. The state equation (1.1) is then associated to a costate or dual 
system, given by 

(1.3) n'ir) = (A - Al)7r{r) - g'Mr)), r e [t, +oo) 

where tt : [t, +oo) — > H (the dual variable, or co-state of the system) is the unknown, and 
y — y{-; t, x, u) is the trajectory starting at x at time t and driven by control u, given by 
(1.1). A transversality condition 

(1.4) lim 7t(T) = 0, 
is also assumed. 

We recall that the problem of minimizing Jca{t,x,u) with respect to u over the Banach 
space 

Ll{t, +oo; U) = {u: [t, +oo) U : t ^ u{T)e~^^ G L^it, +oo; U)}, p> 2, 

was studied in a previous paper by Faggian and Gozzi [30], deriving existence and unique- 
ness for the associated Hamilton- Jacobi-Bellman (briefly, HJB) equation 

(1.5) -Xijj{x) + {^'{x),Aox) - h*Q{-B*ij'{x)) + g{x) = 0, 

and a feedback formula for optimal controls in terms of the spatial gradient of the value 

function. All such results are recalled in Section 2. 

Thus in the present paper some further results are achieved: 

• we establish necessary and sufficient optimality conditions for open loop controls, 
that is, the Pontryagin Maximum Principle (Theorem 4.7) ; 

• we show that the co-state variable coincides with the spatial gradient of the value 
function evaluated along the trajectory of the state equation, creating a connection 
between Maximum Principle and Dynamic Programming (Lemma 4.8). 

Moreover, in Section 3 the reader will find the economic application to optimal investment 
with vintage capital. 

1.1. Bibliographical notes. It is well known that control problems with unbounded 

control operator B arise when we rephrase into abstract terms some boundary control 
problem for PDEs (or, more generally, problems with control on a subdomain). Indeed, 
we motivate our framework with the application to the economic problem of optimal 
investment with vintage capital in the framework by Barucci and Gozzi [12] [13] that we 
describe in detail in Section 3. Similar problems with unbounded control operator have 
been discussed in a series of papers by this author and others. The unconstrained case 
has been studied both in the case of finite and infinite horizon [26, 27, 30] while [29] 
contains the finite horizon case with constrained controls. The (finite horizon) case with 
both boundary controland state constraints is treated in [28]. 

Some further references on boundary control in infinite dimension follow. We recall that 
such problems have been studied in the framework of classical/strong solutions and in that 
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of viscosity solutions. Regarding Dynamic Programming in the classical/strong frame- 
work, the available results mainly regard the case of linear systems and quadratic costs 
(where HJB reduces to the operator Riccati equation). The reader is then referred e.g. to 
the book by Lasiecka and Triggiani [41], to the book by Bensoussan, Da Prato, Delfour and 
Mitter [14], and, for the case of nonautonomous systems, to the papers by Acquistapace, 
Flandoli and Terreni [2, 3, 4, 5]. For the case of a linear system and a general convex cost, 
we mention the papers by this author [24, 25, 26, 27]. On Pontryagin maximum princi- 
ple for boundary control problems we mention again the book by Barbu and Precupanu 
(Chapter 4 in [11]). 

For viscosity solutions and HJB equations in infinite dimension we mention the series 
of papers by Crandall and Lions [18] where also some boundary control problem arises. 
Moreover, for boundary control we mention Gozzi, Cannarsa and Soner [17] and the paper 
by Cannarsa and Tessitore [19] on existence and uniqueness of viscosity solutions of HJB. 
We note also that a verification theorem in the case of viscosity solutions has been proved 
in some finite dimensional case in the book by Yong and Zhou [43]. We finally mention 
the paper by Fabbri [23] where the author derives an existence and uniqueness result 
for the viscosity solution of HJB associated to optimal investment with vintage capital 
(with infinite horizon and without constraints), that is the application of Section 3 of the 
present paper, obtaining the results by making use of the specific properties of the state 
equation, while no result is there provided for the general problem. 

We mention also some fundamental papers and books on the case of distributed control 
in the classical/strong framework such as the works by Barbu and Da Prato [7, 8, 9] for 
some linear convex problems, to Di Blasio [20, 21] for the case of constrained control, to 
Cannarsa and Di Blasio [16] for the case of state constraints, to Barbu, Da Prato and 
Popa [10] and to Gozzi [35, 36, 37] for semilinear systems. 

Regarding applications, on control on a subdomain (boundary or point control) we refer 
the reader to the many examples contained in the books by Lasiecka and Triggiani [41], 
and by Bensoussan et al [14]. Moreover, for economic models with vintage capital the 
reader may see the papers by Barucci and Gozzi [12], [13], the papers by Feichtinger, Hartl, 
Kort, Veliov et al. [31, 32, 33, 34], and for population dynamic the book by lannelli [40], 
the paper by Ani^a, lannelli, Kim and Park [1], and the papers by Almeder, Caulkins, 
Feichtinger, Tragler, and Veliov [6] and references therein. 



2. Preliminaries 

We here recall all the relevant results that are needed in the sequel. According to the 
notation in [30], if X and Y are Banach spaces, we denote by | • |x the norm on X, by | • | 
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the euclidean norm in R, and we set 

Up{X; Y) = {f:X^Y : [/], := sup '^^f ~ ^f^^'^ < +00} 

x,yex, x+y p — y|x 

CL,(X) := {/ e C\X) : [/'], < +00} 

Br{X,Y) ■={j:X^Y : := sup < +00}, Br{X) := B,(X,M). 

Moreover we set 

So(X) := {w e B2(X) : is convex, w e Cl^p(X)}. 
All the spatial derivatives above have to be intended as Prechet differentials. 

Then we consider two Hilbert spaces V. V, being dual spaces, which we do not identify 
for reasons which arc recalled in Remark 2.2 and wc denote the duality pairing by (■, ■). 
We set V as the state space of the problem, and denote with U the control space, being 
U another Hilbert space. The state space is V and the control space is U. For any fixed 
X in V and t > and t >t, the solution to the state equation in V is given by variation 
of constant formula by 

(2.1) y{T) = e^^-^^^x + e^^-''^^Bu{(j)da, r e [t, +oo[, 

while the target functional is of type 

/+00 
e-^^[go{,y{,T)) + ho{u{T))]dT. 

We assume the following hypotheses hold: 

Assumptions 2.1. 1. A : D{A) C y — > V is the infinitesimal generator of a 
strongly continuous semigroup {e^^}T>o on V; 

2. Be L{U,V'); 

3. there exists a; > such that \e'^^x\^, < e'^'^\x\^,, Vr > 0; 

4. ^o>oeSo(n 

5. ho is convex, lower semi-continuous, duho is injective. 

6. K{0)^0, /iSeEo(y); 

7. 3a > 0, 36 e R, 3p > 2 : ho(u) > a\ufu + b,yue U; 

Moreover, either 
8.a p > 2, A > 2a;. 
or 

8.b A > a;, and 5-0,00 G Bi{V'). 

Remark 2.2. We do not identify V and V for in the applications the problem is naturally 
set in a Hilbert space H, such that V G H = H' G V (with all bounded inchisions). 
Indeed, in order to avoid the discontinuities due to the presence of as they appear in 
(1.1) (1.2), we work in the extended state space V related to H in the following way: V is 
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the Hilbert space D{Aq) endowed with the scalar product {v\w)v '■— {v\w)h+{Aqv\A^w)h, 
V is the dual space of V endowed with the operator norm. Then assume that B e 
L(f/, V), and extend the semigroup {e*'^°}t>o on to a semigroup {e*'^}t>o on the space 
V , having infinitesimal generator A, a proper extension of Aq. The reader is referred to 
[27] for a detailed treatment. The coefficient uj could be any real number, but is assumed 
positive in order to avoid double proofs for positive and negative signs. □ 

Remark 2.3. Note that the functions g and (/? arising from applications usually appear 
to be defined and on H ^ not on the larger space V . Then, we here need to assume 
that they can be extended to -regular functions on V - which is a non trivial issue. 
We refer the reader to [26], [27] and [30] for a thorough discussion on this issue. □ 

The functional Joo(^; u) has to be minimized with respect to u over the set of admissible 
controls 

(2.3) Ll{t, +oo; U)^{u: [t, +oo) ] u{T)e~^ G LP{t, +oo; U)}, 
which is Banach space with the norm 

/"^°° -A 
\MLl{t,+oo;U)^ J HT)fu(^ ^dT=\\e ^ u\\LP(t,+oo;U)- 

The value function is then defined as 

Zoo{t,x)= inf Joo{t,x,u). 

ue-L^(t,+oo;C/) 

As it is easy to check that 

one may associate to the problem the following stationary HJB equation 

(2.4) -\i:{x) + {ij'{x),Ax) - /i*(-5*^'(a;)) + g{x) = 0, 
whose candidate solution is the function Z^{0, •). 

We will use the following definition of solution for equation (2.4). 

Definition 2.4. A function ip is a classical solution of the stationary HJB equation (2.4) 
if it belongs to T,o{V') and satisfies (2.4) for every x G -D(^). 

Theorem 2.5. Let Assumptions 2.1 hold. Then there exists a unique classical solution 
^ to (2.4) and it is given by the value function of the optimal control problem, that is 

*(a;) = Zoo(0,a;) = inf Joo(0,x,u). 

u£Ll(0,+oo;U) 

Once we have established that ^ is the classical solution to the stationary HJB equation, 
and that it is differentiable, we can build optimal feedbacks and prove the following 
theorem. 
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Theorem 2.6. Let Assumptions 2.1 hold. Let i > and x & V be fixed. Then there 
exists a unique optimal pair {u*,y*). The optimal state y* is the unique solution of the 
Closed Loop Equation 

(2.5) y{T) = e("-*)^x + e^^-''^^B{hiy{-B*^'{y{s)))da, r e [t, +oo[. 
while the optimal control u* is given by the feedback formula 

u*{s) = ih*n-B*^'iy*m. 

3. The motivating example 

We here describe our motivating example: the infinite horizon problem of optimal invest- 
ment with vintage capital, in the setting introduced by Barucci and Gozzi [12] [13], and 
later reprised and generalized by Fcichtinger et al. [31, 32, 33], and by Faggian [26, 27]. 
The capital accumulation is described by the following system 

(3.1) I y{r,0)^uoir), r e]t,+oo[ 

[ y{t,s)^x{s), se[0,s] 

with t > the initial time, s G [0, +oo] the maximal allowed age, and r G [0,T[ with 
horizon T — +oo. The unknown y{r, s) represents the amount of capital goods of age s 
accumulated at time r, the initial datum is a function a; G L^(0, s), > is a depreciation 
factor. Moreover, uq : [t,+oo[-^ M. is the investment in new capital goods {uq is the 
boundary control) while Ui : [t, +cxo[x [0, s] ^ R is the investment at time r in capital 
goods of age s (hence, the distributed control). Investments are jointly referred to as the 
control u = {uq,Ui). 

Besides, we consider the firm profits represented by the functional 

/ + 0O 
e-^^[R(Q(r)) - c(u(T))]dT 

where, for some given measurable coefficient a, we have that 

Q(r) = / a{s)y{T,s)ds 
Jo 

is the output rate (linear in ^(t)) i? is a concave revenue from Q{t) (i.e., from y{T)). 
Moreover we have 

c(uo(r),ui(T)) = / ci(s,ui(T,s))ds + co(uo(t)), 
Jo 

with Ci indicating the investment cost rate for technologies of age s. cq the investment 
cost in new technologies, including adjustment-innovation, cq, Ci convex in the control 
variables. 
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The entrepreneur's problem is that of maximizing I{t, x; Uq, Ui) over all state-control pairs 
{y, (1*0,^^1)} which are solutions in a suitable sense of equation (3.1). Such problems are 
known as vintage capital problems, for the capital goods depend jointly on time r and on 
age s, which is equivalent to their dependence from time and vintage t — s. 

When rephrased in an infinite dimensional setting, with H :— L^{0, s) as state space, the 
state equation (3.1) can be reformulated as a linear control system with an unbounded 
control operator, that is 



(3.2) 



y'{T) = Aoyir) + Bu{t), t e]t, +oo[; 
y{t) = X, 

where y : [t,+oo[— > H, x & H, Aq : D(Aq) G H ^ H is the infinitesimal generator of 
a strongly continuous semigroup {e^°*}t>o on H with domain D{Ao) = {/ G H\0,s) : 
/(O) = 0} and defined as Aof{s) = —f'{s) — nf{s), the control space is U = x H, the 
control function is a couple u = {uo,Ui) : [t,+oo[-^ M.X H, and the control operator is 
given by Bu = B{uo, Ui) = Ui + UqSq, for all {uq, Ui) eM.x H, Sq being the Dirac delta at 
the point 0. Note that, although B ^ L{U, H),is B e L{U, D{A*y). The reader can find 
in [12] the (simple) proof of the following theorem, which we will exploit in a short while. 

Theorem 3.1. Given any initial datum x & H and control u e L^(t, +oo;[/) the mild 
solution of the equation (3.2) 

belongs to C{[t, +00); H). 
Following Remark 2.2, we then set 

V = DiA*) = {feH\0,s):f{s) = 0} 
and V = D^Aq)'. Regarding the target functional, we set 

Joo{t,x;u) := -I{t,x;uo,ui), 

with: 

go -.V'^R, goix) = -R{{a,x)), 

Hq: U ^R, ho{u) = Co(mo) + £ Ci{s,ui{s))ds. 

Remark 3.2. Here the extension of the datum go to V is straightforward, as long as we 

assume that a E V and replace scalar product in H with the duality in V, V'. 

Note further that a; = 0, A > (the type of the semigroup is negative and equal to — /i). 

□ 

As the problem now fits into our abstract setting, the main results of the previous sections 
apply to the economic problem when data R, cq, ci satisfy Assumption 2.1[8.a] or [8.b]. 
In particular, such thing happens in the following two interesting cases: 
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• If we assume, for instance, that i? is a concave, C^, sublinear function (for example 
one could take R quadratic in a bounded set and then take its linear continuation, 
see e.g. [31, 33]), and cq, ci quadratic functions of the control variable, then 
Assumption 2.1[8.b] holds. 

• Assumption 2.1 [8. a] is instead satisfied when R is, for instance, quadratic - as it 
occurs in some other meaningful economic problems - and Cq, Ci are equal to +oo 
outside some compact interval, and equal to any convex l.s.c. function otherwise. 
Such case corresponds to that of constrained controls (controls that violate the 
constrain yield infinite costs). 

In these cases. Theorems 2.5, 2.6 hold true. In particular Theorem 2.6 states the existence 
of a unique optimal pair {u*,y*) for any initial datum x G V. Note that in general the 
optimal trajectory y* lives in V. However, since the economic problem makes sense in H, 
we would now like to infer that whenever x (the initial age distribution of capital) lies in 
H, then the whole optimal trajectory lives in H. Indeed, this is guaranteed by Theorem 
3.1. 

All these results allow to perform the analysis of the behavior of the optimal pairs and 
to study phenomena such as the diffusion of new technologies (see e.g. [12, 13]) and the 
anticipation effects (see e.g. [31, 33]). With respect to the results in [12, 13], here also the 
case of nonlinear R (which is particularly interesting from the economic point of view, as 
it takes into account the case of large investors) is considered. With respect to the results 
in [31, 33], here the existence of optimal feedbacks yields a tool to study more deeply the 
long run behavior of the trajectories, like the presence of long run equilibrium points and 
their properties. 

4. The Maximum Principle 

Let X & V and i > be fixed, and consider the dual system associated to (1.1), that is 

(4.1) n'{r) = (A - A*)7r(r) - g'Mr)), r e [t, +oo) 

where tt : [t, +oc) V (the dual variable, or co-state of the system) is the unknown, and 
y = y{-; t, x, u) is the trajectory starting at x at time t and driven by control u, given by 

(2.1) . We assume such equation is also subject to the following transversality condition 

(4.2) lim tt(T) = 0. 

We denote any solution of (4.1)(4.2) also by Tr{-;t,x,u) or by Tr{-;t,x) to remark its 
dependence on the data. 

Definition 4.1. Let Assumptions 2.1 [1-7] be satisfied. We define the mild solution of 
(4.1)(4-2) o-s the function n : [t,-\-oo) V given by 

/ + 00 
e(^o-^^('^-)g'Ma))da. 

In the sequel we show that such definition is natural. 
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Lemma 4.2. Let Assumption 2.1 [1-7] he satisfied, and assume p>2 and X > 2uj. Then 
TT given by (4-3) is well defined and belongs to C°(i, +oo; V). 

Moreover: 

{i) if p > 2 then n G +oo; V); 

(ii) ifp = 2 then tt e Ll^^{t, +oo]V) n L'^{t,T]V), V T < +oo, e > 0. 

Proof. Note that by assumptions on g'g, the integrand in (4.3) can be estimated as follows 

|e(^S-A){-r)^;(^(a))|^ < |5^|B,e-(^-)(---)(l+ |y(a)|^,), 

hence to prove the first assertion it is enough to show that a i— > e~^^~'^^"'\y{a)\^, is in 
L\t, +oo). 

By Lemma 4.5 contained in [30] one has 



(4.4) 



\y{(T)\^, < Ce^^ (^\x\^, + £ e-n<r)\udr^ 
<Cie--(l + p(i,(T)i) 

for suitable constants C (depending only on t) and Ci (depending from t, x, and u), where 



\M--w)t q(--w]a\ \ / 

\t — a\ \ — cop. 



p{t,a) 

Hence 



e-(^--)'^|?/(a)|^, < Cie-(^-2-)'^(l + p(t,a)^), 
so that in the case X ^ cup one obtains 

(4.5) e-^^-^^^" p(t, a)-^ < \e-^>^-^^^'' - e-(^-9'-)^|5 < Cae"^'^-""'^ 
for a suitable constant C2, whereas in the case X = cup one has 

(4.6) e-(^-2'^)^p(i,(7)^ < e-^^-^^^\t - a\-^ . 
Similar estimates lead to the proof that n G C^{t, +00; V). 

Next we prove that if > 2 then tt G L\{t, +00; V). From the estimates above, one has 



I „/ 1 I „/ 1 r'c^T r+00 

n{r)\y <M^+ + \g'o\B.Ce^'-^^ / e'^'-^^'^ p{t,a)Ua 

X — uj X — 2u 

= 7i(^) + 72(r) + 73(^)- 



The functions 71 and 72 are trivially in L'i^{t, +00; M). Regarding 73, in the case A = up, 
let 5 > such that A > max{2a;, q{u! + 5)}, so that there exists some T > t such that 



a > T ^ e-^^H - a\~^ < 1. 
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Then 

e-i^-^^)''\t-a\Ua < / e-^^-^''^''\T - t\Ua + / e'^^-'^'^-^^" da 

^-{\-2co)t ^ g-(A-2a;-5)T 

I I I 
- A-2a; ' ' A - 2a; - 5 

= 74 (t) + 75 (t) 
Now for a suitable constant C3 one has 

(4.8) e-^^e''(^-'^)"[74(r)« V 75(r)«] < C3e-[^-('"+^)«]^ 

which is integrable functions in [t, +00). In the case A ^ cup, by means of (4.5) one has 



(4.9) '"^'^'<^*' ^ 



g -ATg9(A-u))rg-[A-2a;]r 



A -2a; 

for a suitable constant C4, which imphes 73 G L\(t, +00; R) also in this case. 

Finally, note that if p = 2, then tt G L^^g(t, +00; F), Vs > follows promptly from (4.8) 

(4.9) . □ 

Theorem 4.3. //tt : [t,+oo) — > F satisfies (4.1) almost everywhere in [t,+oo) and (4.2) 
^/len TT is also a mild solution to (4.1)(4.2). 

Proof. By variation of constants formula, any tt satisfying (4.1) a.e. is given by 

(4.10) 7r(r) = e(^S-^)(^-")7r(r) + j\^^o-^^^''-^^ g'^{y{a))da, VT > t, Vr G [t,T]. 

Note that (4.2) imphes 

lim |e(^S-A){T-r)^/y^, < ^-^ e^'^-^^^^"") |7r(7^) k = 0. 

T->+oo T-»+co 

hence by passing to hmits as T — > +00 in (4.10) one derives 

7r(r)= lim / e^'^*^-^^^''-^^ g'^{y{a))da = e^^*'^-^^^"-^^ g'M^))da 

where the last equality follows from estimates (4.5) (4.6). □ 

Remark 4.4. Assume p > 2, X > 2uj. By means of the same estimates contained in the 
proof of Lemma 4.2, one may show that 

• A < a;p implies y e L^{t,+oo;V') for all r < -, and y e Lp (t,T;V') for all 
T<+c5o; ^ 

• A > a;p implies y e U'{t, +00; V) for all r < p, and y e LP{t,T;V') for all 
T < +00. 
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Definition 4.5. Let Assumption 2.1 [1-7] be satisfied, and assume p > 2 and A > 2a;. 
Let also T > t be either finite or +oo. We say that a given pair {u,y) e L\{t,T\ U) x 
Llg^{t,T;V') is extremal if and only if there exists a function n e Ll^{t,T;V) satisfying 
in mild sense, along with u and y, the following set of equations 

y'ir) = Ay{r) + Bu{t), t e [t,T)- y{t) = x 

n'{r) = {\-A*)7r{T)-g'Mr)), r e [t,T)- 
lim 7r(s) — 0, when T — +oo; 7r(T) — 0, when T < +00 

s— >+oo 

(4.11) -5*7r(r) e dho{u{T)), for a.a. t e [t,T). 

Renicirk 4.6. Note that, by conjugation formula, we have 

-B*niT) e dhoiuir)) ^ uir) = (/i*)'(-i3*7r(r)). 
We refer to such condition as to maximum principle condition. 



The next goal is to characterize optimal couples as extremal couples for the system. 
Then the following theorem holds true. 

Theorem 4.7. (McLximum Principle). Let Assumptions 2.1 [1-7] be satisfied, A > 2a;. 
Then, for all p >2 and T < -\-oo, the couple {u*, y*) is optimal at {t, x) - for the problem 
of minimizing (1.1) (2. 2) - if and only if it is extremal. 

Proof. Let K : Ll{t, T;U)^RU {+00}, and G : Ll{t, T;U) ^RU {+00} be defined by 

K{u) = J^ e-^^ho{u{T))dT, G{u) = e-^^go{y{T;t,x,u))dT 

so that \/u e dom{K) n dom{G) we have 

J{u) = K{u) + G{u), and dJ{u) = dK{u) + dG{u). 



Claim 1: 
(4.12) 

Indeed 
(4.13) 



dK{u) = S, where 
S = {if e Ll(t,T-U) : ip{T)e dhoiuir)), a.a.Te[t,T)} 



dK{u)^\^^eLl{t,T;U) : 

[ho{w{T)) - ho{u{r)) - {^{t)\w{t) - u{T))u]dr > 0, V«; e L^(t,T; f/)|, 
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SO that S C dK(u) is straightforward. To show the reverse inclusion, we let v be any 
fixed element of dk{u), E any measurable subset of \t,T), and we set 



u{t), t^E 
w{t), t & E 



(4.14) w{t) 
We then derive 

/ [ho{w{T))-ho{u{T))-{^{T)\w{T)-u{T))u]dr>0, yweLl{t,T;U), 

which implies, since E and w where arbitrarily chosen, 

ho{w{r)) - ho{u{r)) - {(p{r)\w{r) - u{t))u > 0, a.a. r e [0, +oo) 
that is, (p{t) G dhoir) for almost all r. On the other hand: 

Claim 2: Assume that {u, y) is extremal. Then {u, y) is optimal. 

Let p be the co-state associated to the extremal couple {u,y), and let v be any control in 
dom{G). Then 

G{v) - G{u) = [^o(y(T; v)) - gMr\ u))\ e-^^dr 

> j\g'o{y{r;u)),J\^^-'^^''B{v{a)-u{a))da)v,v'e-^^dT 



T i-T 



( j B*e^^-''^^'og'^^y^r;u))\v{a) - u{a)) ^e-^^ drda 

J a 

= r { r B*e^--'^^^^o-^^g'Mr;u))\v{a)-u{a)^e-^'^da 

Jt Ja 



where we could exchange the order of integration due to the fact that tt associated to an 
extremal couple is in L\{t, +oo] V) by definition. Then we proved that 

S*7r e dG{u). 

Since by assumption we also know that —B*T:{a) e dho{u{a)) almost everywhere in 
[i, -|-oo[, we have also —B*n e dK{u) and hence dJ{u) 3 0, that is u is optimal. 



Claim 3: Assume that {u*,y*) is optimal, and let tt* be the associated costate. Then G is 
Gateaux differentiate in u* with G'{u*) = B*7r*. 
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Indeed, for any fixed v in L\{t, +00; C/), and any e > 0, there exists < eo < e sucfi that 

G{u* + ev) - G{u*) 



I! 



{B*TT*,v)li LP 



go{y{T; u* + ev)) - go{y*{T)) 
e dr - {B n ,v}li 



e^^-''^^Bv{a)da 



ci)yyie ^'^ dr 



e-^^dT =: / 



We estimate now the right hand side in the case A ^ up. By Holder inequahty one has 



''^^Bv{a)da 




j\i-p-^)<i''da 




v 

















\B\ 



L{Uy>)\MLl{t,T-,U) 



\B\\L(U,V')\\v\\Ll{t,+oo;U) 



Then, for a suitable constant C3 we have 



/ < 



bo] ^0 1 1 -B 1 1 1 1 1 1 (t_+oo;!7) 



— uj\iq'' 



i: 



[^-^)i^ _ jj-^)n 



g(a;-A)r^^ 



and since p>2=^A^^ — 1^— a;<0, then one may let e — > and obtains that the right 
hand side in (4.15) goes to 0. If instead A = a;p by Holder inequality one has 

e^^-''^'^Bv{a)da 



v 



< e""^ / e p''\v{a)\uda\\B\\L{u,v')\\v\\Li{t,T;U) 



L{U,V')\\V\\Ll{t,T;U) 



Then 



and by letting e — > the right hand side goes to 0. 



The proof of necessity is then straightforward: from optimality of u* we have J{u*) 3 0, 
then from Claim 1 and Claim 3 we derive condition (4.11). □ 
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Lemma 4.8. Let {u*,y*) be optimal at {0,x) and let 7r*{-;0,x) be the associated co-state. 
Then 

=7r*(0;0,a;). 

Consequently, 

Proof. To derive the first assertion it is sufficient to prove that p*{0;0,x) is in d'i/^x). We 
recall that in Theorem 4.7 we showed that —B*7t*{t) G dho{u*{T)) almost everywhere in 
[0, +00). Then, for all x G V, and their associated controls u optimal at (0,a;), we have 

- ^'(x) = Joo(0, X, u) - J(0, X, u*) 

"+00 



> 



{9'o(y*(r)),y{T) - y*(T))v,v' - (B*n*(T;0,x)MT) - u*(t))u 

Jo L 

Note that 

{9oiy*ir)),y{T)-y*{T))y,y>^ 

= {g'o{y*{r)),e^^x -x)+ r e^^^-^^B{u{a) - u\a))da)v,v' 

Jo 

= {B*e^'o^^-'^^g',{y*{T)),x-x)vy, + {B*ti*{t-Q,x))\u{t)-u*{t))u 

hence 

/■+00 

- -^{x) > { / B*e^^o-^^^g'o{y*{T))e-^^dT, x - x)v,v' 
Jo 

= (7r*(0;0,x),x - x)v,v'- 

The proof of the second statement is standard and we write it here for the sake of com- 
pleteness. Note that 7r(0; 0, y*(r)) is the costate associated to any couple, optimal at 
(0, ?/*(r)), say tio,2/*(r) a-nd 0, t/*(T), Mo,y*(r))- Observe also that the control defined by 

U0,y*iT){<7) = U*{a + T) 

is optimal at (0,i/*(r)), and consequently the associated trajectory satisfies 

y{(T;0,y*{T),uo^y*lr)) = y{(^ + r;T,y*{T),u*) = y*{a + T). 

Then 

^'{y*{r))=p{0;0,y*{T)) 
r+00 

= / e^^o-^^'^g'o{y{r;0,y*{T),uo,r^,)))da 
Jo 

r+00 

= / e(^o-^^'^g'oiy*i<T + r))da 
Jo 

e(^o-m--r)g'^^y^r)dr 
7r(r;T, t/*(r)) 

□ 
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